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Abstract 

Under the constraint of classroom time, English as foreign language (EFL) learners usually do not have adequate 
opportunity to practice oral English in class nor receive individualized feedback from the instructor. After-class practice 
constitutes an essential component of foreign language learning. This study investigated the effect of utilizing rubrics on 
EFL learners’ oral English using a 16-week experiment and a questionnaire. A total of 61 college students participated 
in the study, 41 in the rubric-mediated group and 20 in the control group. They were required to complete six tasks of 
three types: conversation, description, and discussion. Participants in the rubric-mediated group were provided with 
three rubrics describing respective task assessment criteria. They were also required to record their speaking, self-assess 
their performance with reference to the rubrics, revise their speaking if they noticed they did not meet the criteria, and 
finally complete a questionnaire. Students in the control group were assigned the same tasks but were not given the 
rubrics. Two oral tests were delivered at the initial and final stages of the study to measure the change in their speaking 
ability. Results revealed that rubrics had positive effects on discourse length, discourse organization, and linguistic 
flexibility but little impact on linguistic accuracy. Responses to the questionnaire indicated that students perceive 
rubrics as a facilitative tool of practice and self-assessment. 
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1. Introduction 

English as foreign language (EFL) learners in China have limited chances to practice oral English in class due, at least 
in part, to the large size of classes. To deal with this constraint, teachers often assigned after-class speaking tasks. 
However, lacking guidance in practice, most learners are not clearly aware of their own speaking weaknesses, nor do 
they know how to adopt varying strategies when facing different speaking tasks. Therefore, independent practice 
usually cannot produce the same effect as instructor guided in-class activities. To address the dilemma, the present study 
intends to investigate the extent to which rubrics may facilitate EFL students’ oral English learning. 

A rubric is a document that describes the expectations for an assignment in an analytical way. It is usually presented in 
two dimensions: a component of pre-established criteria and performance levels in which performance features of each 
level is described in contrast with those of other levels (Goodrich 1997; Andrade 2000; Stevens and Levi 2005) (see 
Appendix for an example). 

Rubrics mainly serve two purposes, to grade student work and to guide students to complete an assignment (Arter and 
McTighe 2001; Stevens and Levi 2005). Regarding the first purpose, since performance features of each level have been 
described in detail beforehand, teachers only need to identify a corresponding level to match students’ real performance 
when they rate students. Due to their efficiency, rubrics have been widely used to evaluate written papers, oral 
presentations, group projects and discussions (e.g. Campbell 2005; Dunbar et al. 2006). 

Second, rubrics are used to facilitate learning by directing students’ attention to specific areas, guiding them to make 
dependable judgments about the quality of their work, and assisting them to revise their work so as to target at a higher 
level. A number of researchers have investigated this instructional value of rubrics. Andrade and Du (2005) explored 
student perspectives on using rubrics to guide and assess students’ learning of the course content. The students 
expressed seven benefits of rubrics. The most commonly cited one is that rubrics communicate the teacher’s 
expectations of assignments and thereby provide guidelines for students’ efforts. Other benefits include directing 
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students to plan a process for a complicated task, assisting them to check and revise their performance, helping them 
better understand teachers’ feedback, encouraging them to take efforts to earn a higher grade, and lowering their anxiety 
about an assignment. 

Reynolds-Keefer (2010) examined how rubrics influenced 45 pre-service teachers’ learning and the likelihood that they 
would use rubrics in the future as teachers. He designed two rubrics for two writing assignments, which presented 
teachers’ requirements and expectations on five aspects of writing, i.e., development of argument, organization, 
mechanics and language, focus, and synthesis. The rubrics also described the features of these five aspects at different 
grade levels. The researcher also administered an open-ended questionnaire at the end of the study to investigate the 
participants’ attitude toward the use of rubrics in the writing course. Results showed that the pre-service teachers had an 
overwhelming positive attitude towards the approach, and they also expressed their willingness to employ the tool of 
rubrics in their own future teaching. 

Andrade and Boulay (2003) examined the impact of rubric-mediated self-assessment on 7th- and 8th-grade students' 
written essays. They implemented two written rubrics which articulated the criteria respectively for two assignments: a 
historical fiction essay and a response to literature essay. They found positive impact of rubrics on girls’ but not boys’ 
historical fiction essays. For the literature essay, no effect had been identified for either girls or boys. 

About twenty more rubric studies have been reviewed by Reddy and Andrade (2010). The studies cover a wide variety 
of disciplines, including the liberal arts, information literacy, medicine, nursing, management, dentistry, food technology, 
teacher education and film technology. Some of the studies reported positive perceptions of rubrics from students and 
teachers. Some other studies documented that rubric use was associated with improved academic performance. This 
plethora of research has not only revealed the impact of rubrics on learning and achievement but also the popularity of 
using rubrics among teachers, for educational research is usually rooted in classroom instructions. 

However, research on the use of rubrics in the educational context of mainland China is rare. Only one study has been 
identified. Thompson (2013) conducted a one-semester research project by creating and implementing a 150-item 
writing rubric to enhance feedback for first-year Chinese EFL learners’ writing at the university level. Rubrics were 
used on a weekly basis. The writing tests showed that students had improved 4-7 percentage points from the beginning 
to the end of the class. Another study was conducted in Taiwan. Hung et al. (2013) examined the influence of using 
rubrics on Taiwanese undergraduates’ oral presentations. The 18 participants were required to give three presentations 
on topics of their choice with a rubric for self-assessment. Results revealed that the use of a rubric enhanced students’ 
understanding and awareness of the nature of presentations and led to improved performance. 

The above review reveals a contrast between the dearth of research in mainland China and Taiwan and the popularity of 
investigation and applications of rubrics in western educational settings. As educational settings with a large number of 
EFL students, exploration of effective tools of self-assessment and practice will be of great significance. Two questions 
guide the present study: 

1. Does rubric-mediated practice and self-assessment improve students’ EFL speaking performance? 

2. What are students’ attitudes towards to the rubrics and perceptions of the impact of using rubrics for oral practice and 
self-assessment? 

2. Method 

2.1 Participants 

Sixty-one first-year university students in a China participated in the study. They were aged from 18 to 20 and all of 
them had received English instruction for 7 to 12 years (including six years formal instruction in high school and 
English is an optional course in primary school). The experiment was conducted in two separate classes, with 41 
students (23 females and 18 males) in the rubric-mediated group and 20 students (9 females and 11 males) in the control 
group. Their EFL level ranged from lower intermediate to upper intermediate, comparatively homogenous, since they 
sit a placement test when they entered the university. 

2.2 Instruments 

Four instruments were employed, namely, 1) two modified College English Test—Spoken English Tests (CET-SET), 
which were used for the pre- and post-tests to measure students’ speaking ability in both the rubric-mediated and the 
control groups; 2) three rubrics for the rubric-mediated group; 3) six spoken tasks for both groups; and 4) an 8-item 
questionnaire, which was utilized to explore the rubric-mediated group’ attitudes and perceptions of the impact of using 
rubrics. 

2.2.1 The Two Modified CET-SET Tests 

The two tests were adapted according to the national CET-SET. The test consisted of three parts: 1) self-introduction 
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and short-questions, 2) oral description and discussion, and 3) follow-up questions. In part 1, all members of a group 
(normally three and in rare condition four members) were required to introduce themselves briefly and the interviewer 
asked each of them one or two questions. In part 2, each candidate was given a visual prompt, which was different from 
each other but sharing a common theme. For example, with the transportation theme, each candidate in the group was 
given a picture depicting one way of transportation, such as by taxi, by bus, or by bicycle. After one minute preparation, 
each candidate was allotted 1.5 minutes to describe the visual prompt as well as to make comments on it. The last part 
was a 4.5-minute group discussion on a topic which was related to the visual prompts. The interviewer ended the whole 
test with one follow-up question to each candidate. 

2.2.2 Three Rubrics 

The three rubrics used by the experimental group were designed by the authors (see Appendix). They were rubrics for 
the conversation, description, and group discussion tasks. The descriptors of the rubrics were guided by the 
Self-Assessment Form for Students’ English Competence (College English Curriculum Requirements, 2007) and the 
rating scales of the CET-SET. 

2.2.3 Six Speaking Tasks 

Participants engaged in six speaking tasks: two conversation tasks, two oral description and two discussion tasks. They 
were assigned to both the rubric-mediated (experimental) and the control groups. The topics were chosen from the 
textbooks that they were using such as communication, entertainment, and advertisement. 

2.2.4 The Questionnaire 

The questionnaire was only administered to the experimental group. Its content covered two aspects: 1) students’ 
attitude towards the rubric; 2) students’ perceptions of the impact of using rubrics for oral practice and self-assessment. 
The questionnaire was composed of eight items, which were on a 5-point Likert-scale ranging from “strongly agree” to 
“strongly disagree”. 

2.3 Procedure 

This study experienced three major phrases. As shown in Table 1, in the first two weeks of the semester, the researchers 
administered the pre-test to both groups. The participants were divided into groups of three and were tested by the two 
researchers. Their performances were measured according to the CET-SET rating scale (See Appendix E). An 
experienced examiner of the CET-SET trained the two researchers, elaborating the detailed gradation of the criterion. 
The whole process of oral tests was audio-recorded. 

Table 1. The sequence of the experimental phases 


Group 

Weeks 1-2 

Weeks 3-14 

Weeks 15-16 

Rubric-mediated 

Pre-test 

6 speaking tasks with the use of rubrics 

Post-test & 




Questionnaire 

Control 

Pre-test 

6 speaking tasks 

Post-test 


From the third week through the fourteenth, students in both groups were required to complete the six speaking tasks of 
three types, i.e., conversation, oral description, and group discussion. The first time each task type was assigned, 
students in the experimental group were given a corresponding rubric, and one of the researchers spent about five 
minutes explaining to students how to use the rubric to self-assess. Students were advised to follow four steps in their 
after-class practice, i.e., 1) practice the oral tasks and audio-record their performance; 2) assess their speaking with 
reference to the corresponding rubric by marking the areas that they needed to improve; 3) practice again with emphasis 
on the specific aspects they noticed from self-assessment; and 4) audio-record a final version that they were satisfied 
with and submit to the teacher via email. Students in the control group were assigned the same tasks. They were also 
required to practice, revise, and submit their recordings, but they had no rubric. After receiving the students recording 
the teacher randomly chose half of the assignments from both groups and provided oral feedback to the whole class in 
the following class. 

3. Results and Discussion 

This section will first present the results of the pre- and post tests of the participants’ speaking performances. Second, 
participants’ responses to the questionnaire will be displayed to explore participants’ attitudes towards to the rubrics and 
perceptions of the impact of using rubrics for their oral practice and self-assessment. 

Research question one: Does rubric-mediated practice and self-assessment improve students’ EFL speaking 
performance? 

Students’ performance in the speaking tests was graded by two researchers. The reliability in pre-test and post-test of the 
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two researchers were generally high, with Cronbach’s Alpha level reaching 0.82 in the pre-test for the experiment group 
and 0.94 for the control group. The post-test reliability of the two groups was 0.86 and 0.93, respectively. 

Table 2. Pre-test statistics 



Experimental group 

Control group 

Speaking subscales 

(n = 41) 

(n = 20) 

(total score =15) 

Mean 

SD 

Mean SD t p 

1) Linguistic accuracy & range 

3.34 

0.52 

3.15 0.52 -1.360 0.182 


2) Discourse length & organization 

3.22 

0.63 

3.18 

0.59 

-0.270 

0.789 

3) Flexibility & appropriateness 

3.38 

0.49 

3.50 

0.58 

0.862 

0.393 

Overall score 

9.94 

1.50 

9.83 

1.41 

-0.290 

0.773 


The CET-SET rating scale was employed to evaluate the participants’ performances on the pre- and post-tests. The scale 
measures speaking by three subscales, including 1) linguistic accuracy and range, 2) discourse length and management, 
and 3) flexibility and appropriateness. Table 2 lists the mean as well as the standard deviation of the experimental and 
the controls groups. The results of the independent t-test showed that the means of the two groups, neither in the three 
subscales nor the overall scores, were not significantly different (/;>().05). Therefore, comparable speaking abilities 
between the two groups could be assumed. In addition, none of the participants received other English instructions 
besides the College English course. Considering these two factors, the post-test scores could be used to explore the 
differences between the experimental and the control groups. 

Table 3. Post-test statistics 


Speaking subscales 
(total score =15) 

Experimental group 
(n = 41) 

Mean SD 

Control group 
(n = 20) 

Mean 

SD 

t 

P 

1) Linguistic accuracy & range 

3.52 

0.52 

3.35 

0.43 

-1.289 

0.182 

2) Discourse length & organization 

3.88 

0.50 

3.33 

0.47 

-4.159 

0.000 

3) Flexibility & appropriateness 

4.17 

0.43 

3.75 

0.47 

- 3.486 

0.001 

Overall score 

11.57 

1.30 

10.43 

1.17 

-0.290 

0.001 


As can be seen in Table 3, among the three subscales of evaluating criteria, significant differences have been found in 
discourse length and management as well as in linguistic flexibility and appropriateness (/;<().05). However, no 
significant difference has been identified in linguistic accuracy and range between two groups (p>0.05). The overall 
scores between the two groups were also significant (p<0.05). 

Before the study, a common weakness among the students is that their utterances were short and brief, and their 
responses to questions were usually not expanded properly. After the length of oral tasks was specified in the rubrics, 
increasingly more students could describe an object with relevant details, narrate an event with specific information, 
support propositions with appropriate evidence, and provide a suitable lengthy response to a question. Similarly, after 
the requirements of discourse organization and the use of different expressions for a certain idea were listed in the 
rubrics, students have improved in these aspects, which were indicated in their higher scores than their previous 
performances and than those of the students who have not given the rubrics. 

However, the results revealed that the rubrics produced little impact on participants’ pronunciation, grammar accuracy, 
or the range of tense usage. Although some common pronunciation errors have been listed in the rubrics, guided by 
Gui’s (2012) report, some students still cannot differentiate the contrasts between IV—Irl or /th/-/s/, /r/ sound is 
mistakenly added to the endings of such words as “China” and “idea”, or syllables are incorrectly added or deleted. 

Research question two: What are students’ attitudes towards to the rubrics and perceptions of the impact of using rubrics 
for oral practice and self-assessment? 

An 8-item questionnaire was designed to investigate participants’ attitudes towards to the rubrics and perceptions of the 
impact of using rubrics for oral practice and self-assessment. Items 1 through 4 intended to examine students’ attitudes 
toward the rubrics, what they thought of the rubrics and whether they took the rubrics seriously. Items 5 to 7 were used 
to investigate how students perceived the influence of rubrics on their after-class practice and self-assessment. The last 
item intended to find if the students want to more rubrics in the future classes. 

Responses to item 1 show that 71% (20% strongly agree and 51% agree) of the participants thought that the rubrics 
were clearly written and easy to follow. This result implies that the rubrics still need to be optimized although most of 
the participants endorse the quality. The revision details should be further explored. 
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Table 4. Attitudes toward and perceptions of the rubrics (N=41) 

Strongly agree Agree Neutral Disagree Strongly disagree 

1. The three speaking rubrics are clearly worded and easy to follow. 

8(20%) 21(51%) 9(22%) 3(7%) 0(0%) 

2. I read the rubrics carefully before I evaluate my speaking performance recordings. 

8(20%) 11(27%) 17(41%) 5(12%) 0(0%) 

3. I revise and improve my answer with reference to the rubrics. 

9(22%) 18(44%) 12(29%) 2(5%) 0(0%) 

4. When I practice, I remember the descriptions in the rubrics and revise my performance accordingly. 

9(22%) 21(51%) 9(22%) 2(5%) 0(0%) 

5. The rubrics help me understand teacher’s requirements better. 

13 (32%) 22(54%) 4(10%) 2(5%) 0(0%) 

6. With rubrics I spent more time on spoken English practice. 

10(24%) 19(46%) 10(24%) 2(5%) 0(0%) 

7. Rubrics help me identify my strengths and weaknesses in English Speaking. 

15(37%) 18(44%) 5(12%) 3(7%) 0(0%) 

8. 1 hope that teachers can provide more speaking rubrics in the future oral English practice. 

_ 17(41%) 19(46%) _ 5(12%) _ 0(0%) _ 0(0%) 

Answers to statement 2 indicate that fewer than half of the participants (20% strongly agree and 27% agree) had read 
the rubrics carefully when they assessed their speaking performance recordings. This finding is in accordance with that 
of Andrade and Du’s (2005) study, which found that ’‘most of the students tend not to read a rubric in its entirety” (p.l). 
Perhaps the participants focused their attention on particular demands rather than the holistic requirement of a certain 
task. This assumption is supported by the responses to statement 3, which reveal that 66% of the students would revise 
and improve their speaking according to the descriptions of the rubrics. Replies to item 4 show that the 73% (22% 
strongly agree and 51% agree) of participants also incorporated the rubric requirements into their practice. To sum up, 
the participants held an overall positive attitude toward the use of rubrics although most of them did not read through 
the rubrics carefully. 

Responses to the subsequent three items, statements 5, 6, and 7, are used to explore how the participants perceived the 
impact of rubrics. To statement 5, “The rubrics help me understand teacher’s requirements better”, 86% participants 
(32% strongly agree and 54% agree) responded positively. This function of communicating teachers’ expectations ahead 
to students has been reported across almost all rubric studies (e.g., Andrade and Du 2005; Reynolds-Keefer 2010; Hung 
et al. 2013). Besides this bridging function between the teacher and the student, responses to item 6 also show that 
rubrics drove 70% (24% strongly agree 46% agree) of the participants to spend more time practicing oral English after 
class. Item 7 of the questionnaire, regarding the impact of rubrics on self-assessment, 81% of the students (37% strongly 
agree and 44% agree) responded that rubrics assisted them to identify their strengths and weaknesses in English 
Speaking. Overall most of the participants believed that rubrics produced a positive impact on understanding 
instructors’ requirements and expectations, facilitating independent practice, and supporting self-assessment. 

The last item concerns participants’ willingness to use rubrics in the future. Results indicate that an overwhelming 
majority of the students (87%) responded that they would like to use rubrics in the future oral English practice. This 
finding underscored Reynolds-Keefer’s (2010) discovery that those who experienced the impact of rubrics are more 
likely to utilize them again. 

In conclusion, the responses to the eight items of the questionnaire reveal that the participants in general hold a positive 
attitude toward the use of rubrics and a perception of positive impact on practice and self-assessment. 

4. Conclusion and Implications 

Noticing the gap between the frequent reports on facilitative functions of rubrics on learning in western countries and 
the paucity of such research in China, this study examined how speaking rubrics might influence Chinese 
undergraduates’ EFL practice and ability. Their attitudes towards to the use of rubrics and perceptions of the impact of 
using rubrics have also been explored. Four major findings have been gleaned. First, the use of rubrics has exerted 
positive impact on students’ oral discourse length and organization as well as vocabulary diversification. 

Second, the use of rubrics produces little effect on pronunciation accuracy. This finding implies that teachers should 
design more pronunciation activities in class. Pronunciation is one of the most challenging skills that can hardly acquire 
by self-learning. Teachers should clearly differentiate skills which necessitate face-to-face instructions from those that 
can be learned by students themselves and assign tasks appropriately. 

Third, students in general held a positive and cooperative attitude toward the use of rubrics in EFL learning. Most of the 
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students employed rubrics as a standard, with which they compared their speaking recordings, guide their practice, and 
revise their performance accordingly, which contrasted with teachers’ presumption before the study that the students 
might not take the rubrics seriously. Their embracing attitude toward the use of rubrics as well as their willingness to be 
guided by further rubrics could be viewed as evidence that more teachers should be encouraged to try out this approach. 

Last, rubrics produce positive impact on students’ practice and self-assessment. The rubrics, especially the specific 
descriptions of the different levels in evaluation make students feel that a higher grade is within reach once more effort 
is invested. This has greatly motivated the students to practice more frequently. Furthermore, rubrics raise students’ 
awareness of their speaking strengths and weaknesses, and therefore direct their attention and efforts to specifics areas 
of their speaking. 

After reporting these four major findings, discussion about a less favorable finding might be a good segue to the final 
point, future research. This study, as well as Andrade and Du’s (2005), found that only half of the students read the 
rubrics in its entirety. Exploration of the reasons behind this phenomenon might shed light on the design of rubrics. 
Reddy and Andrade (2010) also expressed their concern about the quality of rubrics in research. They proposed that 
“Future studies should report how the validity of a rubric was established, and the scoring reliability, including rater 
training and its contribution towards achieving inter-rater reliability, and perhaps even the correlation between 
rubric-referenced scores and other measures of performance” (p.446). It is hoped that discussion about the approaches 
to design highly valid and reliable rubrics as well as further investigation about the impact of rubrics on learning might 
inspire more teachers’ interest in the use of rubrics. 
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Appendix 


Picture description assignment rubric (20 points) 


Domain 

5 points 

4 points 

3 points 

2 points 

Pronunciation 

■ shows clear 

■ shows no serious 

■ makes pronunciation 

■ mispronounces words 

and intelligibility 

pronunciation 

pronunciation 

mistakes occasionally 

often 


■ is effortless to 

problems 

■ speaks in sense groups 

■ is hard to understand 


understand 

■ is easy to understand 

most of the time 

■ speaks with no clear 


■ uses a full range of 

■ shows some 

■ has limited ability to 

sentence stress, or 


pronunciation features, 
such as liaison, 
contraction, and 
reduction 

pronunciation 
features, such as 
liaison, contraction, 
and reduction 

speak with liaison, 
contraction, or 
reduction 

sense groups 

Grammar and 

■ produces accurate 

■ produces accurate 

■ makes some mistakes 

■ makes grammar errors 

vocabulary 

sentence structures 

sentence structures 

in sentence structures 

often which 


consistently 

most of the time 

■ uses words with 

sometimes lead to 


■ uses words with high 

■ uses words with 

limited accuracy and 

misunderstanding 


flexibility and precision 

■ uses descriptive words 
appropriately 

■ uses connectives 
naturally 

some flexibility 
■ shows awareness of 
using connectives 

flexibility 

■ uses simple words 
repetitively 

■ attempts to use words 
of similar meaning but 
fail 

Details of 

■ describes pictures 

■ describes most 

■ describes some of the 

■ describes few features 

description. 

thoroughly and 

features of the 

features in the picture. 

in the picture 

discourse length. 

correctly including 

picture clearly 

■ shows some 

■ gives incorrect 

and organization 

almost every detail 

■ organizes most of the 

misunderstanding of 

information 


■ follows a clear order 

descriptions in an 

the information 

■ shows no order of the 


(e.g., from most salient 

appropriate way 

■ arranges some of the 

description 


features to less 

■ produces about 130 

descriptions poorly 

■ produces fewer than 


important ones, from 
center to the 
surrounding) 

■ makes full use of 1.5 
minutes allotted for the 
description task, and 
produces at least 150 
words** in this time 
slot 

words in 1.5 minutes 

■ produces about 100 
words in 1.5 minutes 

80 words in total 

Fluency and 

■ speaks fluently with 

■ speak fluently but 

■ speaks with frequent 

■ speak with long 

coherence 

little repetition or 

with some pauses. 

pauses and hesitations 

pauses 


hesitation 

hesitation, and 

due to searching words 

■ has limited ability to 


■ develops ideas in a 
natural and logical way 

self-corrections 
■ develops most of 
messages logically 

or ideas 

■ shows some ability to 
let sentence idea 
develop naturally 

link sentences 


Notes: * The grade level of 1 point has not been presented since almost no student in this sample was at 1 point level. 


** The requirements of the speech rate were based on another study by the researchers. They found the average speech rate is about 
80 words per minute for a similar group of students. 
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